<html>
<head>
<title>Slug: A Semantic Web Crawler</title>
</head>

<body>

	<p align="center">
		<a href="http://www.ldodds.com/projects/slug"><img src="slug.jpg" border="0"/></a>
	</p>

	<p>
		<h2 align="center">Slug: A Semantic Web Crawler</h2>
	</p>

	<p>
	Slug is a web crawler (or <a href="http://rdfweb.org/topic/Scutter">Scutter</a>) designed for harvesting semantic web content.
	Implemented in Java using the <a href="http://jena.sourceforge.net">Jena</a> API, Slug
	provides a configurable, modular framework that allows a great degree of flexibility in
	configuring the retrieval, processing and storage of harvested content.</p>
	<p>
	The framework
	provides an RDF vocabulary for describing crawler configurations and collects metadata
	concerning crawling activity. Crawler metadata allows for reporting and analysis of
	crawling progress, as well as more efficient retrieval through the storage of HTTP
	caching data.
	</p>

	<h3>Documentation Index</h3>
	
	<ul>
		<li><a href="releases.html">Download the latest release</a></li>
		<li>Read how to <a href="install.html">Install and Run</a> the Scutter</li>
		<li>Slug <a href="config.html">configuration files</a> and options</li>
		<li>Slug supports <a href="profiles.html">profiles</a> to allow for different crawling strategies</li>
		<li>See how the scutter organizes it's <a href="memory.html">memory</a></li>
		<li>Read <a href="how-to.html">how to</a> use Slug to carry out some specific tasks
		<li>Consult <a href="api/index.html">the API documentation</a> for additional notes on each component.</li>
		<li>Planned future developments are outlined in the <a href="roadmap.html">roadmap</a></li>
	</ul>
	
	<hr/>
	<font size="smaller">
	Image courtesy of <a href="http://flickr.com/people/enygmatic/">Elroy Serrao</a>.
	</font>
</body>

</html>